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Losing My Religion? The Impact of Spiritual Cues on 
Noncognitive Skills 

Daniel H. Bowen, Rice University 
Albert Cheng, University of Arkansas 

Studies consistently show that Catholic schools produce positive impacts on educa¬ 
tional outcomes. Many charter school networks in the United States now provide, 
what are essentially, secularized versions of the Catholic education model. How¬ 
ever, charter schools cannot legally replicate the overt religious curriculum and mis¬ 
sion of Catholic schools. Although difficult to disentangle its impactsfrom confound¬ 
ing variables, research suggests that religiosity is a positive predictor of educational 
outcomes. This relationship might suggest that religious-based education produces 
effects on outcomes of public value that could be difficult to replicate in secular¬ 
ized contexts. To examine this question we conducted an experiment where 180 
secondary school students were randomly assigned to a priming task with religious, 
secularized, or neutral cues. We find that religious cues increase students’ self-reg¬ 
ulatory capacities, a predictor of educational attainment, and boost political toler¬ 
ance. These findings provide preliminary evidence to suggest that religious-based 
education provides benefits that secularized equivalents cannot fully emulate. 

Keywords: religious education, charter schools, school choice, noncogni¬ 
tive skills, civic education 

S tudents attending private religious schools in the United States tend to 
exhibit higher levels of academic achievement than their public school 
counterparts (Jeynes, 2012). Catholic schools, in particular, have been very 
successful with improving students’ educational outcomes, especially with his¬ 
torically underserved students (e.g., Altonji, Elder, 8cTaber, 2005; Bryk, Lee, 8c 
Holland, 1993; Evans 8c Schwab, 1995; Grogger 8c Neal, 2000; Hoffer, Greeley, 
8c Coleman, 1985; Kim, 2011; Neal, 1997; Sander 8c Krautman, 1995). Schol¬ 
ars attribute these successes to various factors that are common to the U.S. 
Catholic education model. Examples include mission cohesion, successes with 
the development of social capital, stronger market pressures, high expectations 
for all students, and school autonomy (Chubb 8cMoe, 1988; Coleman 8c Hof¬ 
fer, 1987; Meyer, 2007). However, the independent role and value of having a 
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student’s education occur within an explicitly religious learning environment 
and its impact on outcomes of public value is rarely given consideration (Bryk 
et al., 1993). 

Assessing these impacts could have meaningful implications for policy 
decisions pertaining to school choice regulations and restrictions. Over 
the past half century, Catholic schools in the U.S. have experienced sharp 
declines in student enrollments, leading to thousands of school closures 
(Meyer, 2007). Given their successes, this trend could be worrisome (Brinig 
& Garnett, 2014; Finn 6c Smarick, 2009). However, many charter school 
networks have imitated many of the core aspects of Catholic schools, with 
the exception of having an explicitly religious mission, curricula, and prac¬ 
tices, in hopes of replicating their successes (Kennedy, 2012; Whitman, 2008). 
Consequently, charter schools have provided, to an extent, secularized ver¬ 
sions of Catholic schools with the advantage of serving as a “free” alternative 
to families in districts without robust voucher programs (McShane 6c Kelly, 
2014). Therefore, with the possibility of charter schools producing the same, 
if not better, public benefits without the oversight of religious institutions, 
then it plausibly becomes easier to justify allocating public subsidies to char¬ 
ter schools (and, simultaneously, more challenging to justify making public 
subsidies available to religious schools) on the grounds of maintaining a strict 
separation of church and state. 

It also becomes difficult to justify making subsidies available to Catholic 
and other religious schools if these schools somehow facilitate socially un¬ 
desirable outcomes. There are deep-seated concerns amongst private school 
skeptics pertaining to the development of students’ civic values, such as 
political tolerance (Godwin 6c Kemerer, 2002). For instance, Gutmann (1995) 
has contended that “Any defensible standard of civic education must be com¬ 
mitted to prepare children for the rights and responsibilities of citizenship 
even over the opposition of their parents” (p. 567). Conversely, should religios¬ 
ity 1 have an independent, positive impact on such outcomes, then secularized 
school counterfactuals might not be able to replicate the successes of Catho¬ 
lic and other religious schools. Such schools may, therefore, warrant public 
subsidization (Boffetti, 2001). 


1 We use the operational definition of “religiosity” as an individual’s personal sense 

of private and public connection, engagement, and dedication to a particular religion (e.g., 
Erickson & Phillips, 2012 ). 
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While publicly-valued benefits of having students learn in religious 
settings are not as intuitive as many of the other staples of Catholic educa¬ 
tion (e.g., high standards, school autonomy, mission cohesion, etc.), there is 
research to suggest that religiosity independently boosts educational out¬ 
comes. Adolescents’ religiosity is significantly, positively associated with 
educational attainment (Erickson & Phillips, 2012). There is also a consistent, 
positive relationship between individuals’ religiosity and capacity to exhibit 
self-regulation (McCullough 8cWilloughby, 2009). Some psychologists have 
maintained that this relationship stems from the fact that religion provides 
practitioners (i.e., individuals who are actively engaged in religious activities) 
with clear, consistent standards that improve and motivate self-regulatory 
behaviors (Geyer 8c Baumeister, 2005; Oner-Ozkan, 2007; Rachlin, 2000). 
However, even with non-practitioners, subtle cues that activate God con¬ 
cepts increase prosocial behaviors, suggesting that instilling a sense of having 
unseen thoughts and actions being monitored significantly affects conduct 
(Shariff 8cNorenzayan, 2007). Collectively, these findings could imply that 
religious learning environments, instruction, and more regular, explicit prac¬ 
tice increase self-regulatory capacities which subsequently increase the likeli¬ 
hood of academic accomplishments such as educational attainment. 

It is difficult to determine the causal relationship between religion and 
educational outcomes. One challenge is that inherent selection is involved 
with school choices. In other words, students enrolled in religious schools 
are fundamentally different than those enrolled in secular schools in ways 
that reflect or lead to disparities in educational outcomes that should not 
necessarily be attributed to school sector choice. Ideally, a randomized con¬ 
trolled trial would make it possible to isolate the causal effects of faith-based 
schools. However, restrictions founded upon research ethics and feasibility 
prevents the possibility of conducting such an experiment. Moreover, even if 
school enrollments were determined more or less by chance, disentangling 
the independent religious effects from other aspects that are highly correlated 
with particular school models remains onerous (Wolf, 2014). 

We have attempted to circumvent these challenges and assess the in¬ 
dependent impacts of religious cues in educational settings by conducting 
a laboratory experiment. In this study students were randomly assigned to 
a priming word scramble task with either religious, secularized, or neutral 
cues; this procedure has become a commonly applied research technique in 
the field of social psychology (Bargh 8c Chartrand, 2014). We then examined 
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whether these different priming conditions produce short-term effects with 
180 secondary school students in terms of self-regulatory capacity, a strong 
predictor of educational attainment, and political tolerance, an outcome that 
is plausibly negatively impacted by religious instruction. Specifically, after the 
word scramble priming task, students were asked to perform a self-regulato- 
ry-depleting, persistence task. After completing these tasks the participants 
answered questions regarding their political tolerance and then provided two 
options for how they preferred to be compensated for their participation. 
They could either accept immediate compensation or receive a marginally 
larger payment for opting to wait a week for their reward. By conducting 
such an experiment, our goal is to better determine whether there is indeed 
preliminary evidence that the regularly-induced, religious conceptualizations 
that are likely provided in faith-based learning environments play a substan¬ 
tial role in significantly impacting educational outcomes of public value. 

The results of our experiment suggest that the regularly-primed conceptu¬ 
alizations that are provided in religious school settings indeed have indepen¬ 
dent, positive impacts on one’s self-regulatory capacity and political tolerance. 
Specifically, students in this study who were randomly assigned to be primed 
with religious cues were twice as likely to defer gratification, relative to those 
in the control group, in terms of opting for the marginally higher, postponed 
payment for participation. Moreover, religiously-primed students were also 
more likely to defer gratification than those receiving secularized equiva¬ 
lents of the religious primes. Religiously primed students also demonstrated 
greater political tolerance than those receiving neutral primes; however, these 
students were no more tolerant than those receiving the secularized primes. 
Finally, students in all three conditions were no different in the extent to 
which they exhibited persistence in the regulatory-depletion task. Since 
participants were assigned by chance to the three experimental groups, we 
believe that these findings provide preliminary, causal evidence to suggest 
that at least part of the successes of Catholic (and, more broadly, religious) 
schools may be attributable to the presence of religious cues, the effects of 
which secularized replicas might not be able to emulate. 

The remainder of the paper is divided into five sections. We begin by 
reviewing the literature on the effects of religiosity on self-regulatory behav¬ 
iors and political tolerance. Next, we explain the methods used in conducting 
our experiment. We present and discuss our findings in the third and fourth 
sections and provide our conclusions in the final section. 
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Literature Review 

Catholic Schools, Religion, and Educational Success 

Several studies have concluded that K-12 Catholic schools produce sig¬ 
nificant, positive outcomes on various measures of success in education, 
especially for historically underserved students (Hoffer, 1997). Providing one 
of the earliest evaluations of Catholic school impacts on student outcomes, 
Coleman, Hoffer, and Kilgore (1981) found that K-12 Catholic schools pro¬ 
duce higher cognitive achievement and develop greater educational aspira¬ 
tions. These findings were later corroborated by Bryk, Lee, and Holland’s 
(1993) comprehensive study of Catholic high schools. More recent analyses 
have produced mixed findings with regard to Catholic school impacts on 
cognitive achievement but results tend to be more consistent, exhibiting 
substantial increases, with regard to students’ likelihood of graduating high 
school and enrolling in college (Altonji et al., 2005; Eide, Goldhaber, 8c 
Showalter, 2004; Evans 8c Schwab, 1995; Figlio 8c Stone, 2000; Grogger 8c 
Neal, 2000; Kim, 2011; Neal, 1997; Nguyen, Taylor, & Bradley, 2006; Sander 
8c Krautman, 1995). 

When comparing student performance across school sectors, researchers 
have tended to focus on differences between traditional public and private 
schools or traditional public schools and charter schools (Braun, Jenkins, 8c 
Grigg, 2006; Center for Research on Education Outcomes, 2013). However, 
some evaluators have conducted analyses that potentially isolate sector effects 
by assessing differences between charter and private religious (Lubienski 8c 
Lubienski, 2006; Scott, Rock, Pollack, 8c Ingels, 1995), private religious and 
private secular (Gamoran, 1996; Kim 8cPlacier, 2004), and private religious 
and public magnet schools (Gamoran, 1996). Results from these studies 
have generally been mixed, with no conclusive trend with regard to plausible 
religious schooling effects. Moreover, a general concern with these studies is 
the likelihood of results being driven by an omitted variable bias that stems 
from the inability to control for unobserved student characteristics that are 
both highly correlated with school sector selection and predictive of student 
achievement. 

Sociologists have investigated environmental factors that could explain 
what makes Catholic schools successful. Parochial schools tend to be success¬ 
ful because of their ability to cultivate social capital among parents, students, 
and school personnel (Coleman 8c Hoffer, 1987). The production of social 
capital among Catholic school communities arises from their religiously- 
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motivated mission to serve not only individual students but also the students’ 
families and surrounding neighborhoods. In contrast, secular private schools 
may also cherish a sense of community but tend to lack many of the struc¬ 
tured components of parochial schools (e.g., weekly gatherings for religious 
services that also serve as social events). This difference in social capital pro¬ 
duction opportunities might explain why Catholic schools have been more 
successful than nonreligious private schools at improving educational out¬ 
comes, particularly with underserved students coming from less-stable home 
environments (Bryk et al., 1993). 

There are four foundational characteristics of Catholic schools that likely 
explain their effectiveness: “a delimited technical core, communal organiza¬ 
tion, decentralized governance, and an inspirational ideology” (Bryk et al., 
1:993, P- 297). While concluding that these core foundational components 
could be implemented in public schools, the authors assert that, although 
unmeasured, the inherently religious aspects of Catholic education are vital: 

To ignore the importance of ideology because it cannot be easily cap¬ 
tured in statistical analyses or summarized with numbers would be a 
serious mistake. Statistical analyses can help us to see some things, but 
they can also blind us to the influence of factors that are beyond their 
current horizons. We believe that the true renewal of our educational 
institutions will require melding insights from scientific pursuit with 
inspiration from our evocative traditions, (p. 304) 

In other words, the foundational characteristics which can be secularized are 
certainly salient to the success, but the power and influences of the religious 
component may produce unique effects that could prove impossible to legally 
imitate outside of a faith-based setting. 

Religiosity and Self-Regulation 

The ability to self-regulate — defined as “how a person exerts control over 
his or her own responses so as to pursue goals and live up to standards” — 
has been found to be a significant predictor of academic achievement (Bau- 
meister 6c Vohs, 2004, p. 500). Students who are better equipped at develop¬ 
ing future-time perspectives fare better in school (Baumeister 6c Heatherton, 
1996; Bembenutty 6c Karabenick, 2004; Mischel, Shoda, 6c Rodriguez, 1989). 
The positive relationships between self-regulation and educational attain¬ 
ment together with the Catholic school effect on high school graduation 
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and college matriculation suggests that Catholic schools potentially increase 
students’ academic attainment through the cultivation of increased self-regu¬ 
latory capacity (Segal, 2008). 

Social psychologists have investigated several mechanisms by which 
religious schools potentially improve students’ self-regulatory capacities. 

From their review of the research on the relationship between religion and 
self-control, McCullough and Willoughby (2009) conclude that religious 
practices are routine exercises of self-regulatory processes and that long-term 
religious involvement leads to substantial increases in one’s ability to exhibit 
self-regulatory strength and recovery Geyer and Baumeister (2005) posit that 
religious practice and conceptualization improves self-regulation because it 
presents individuals with clear and consistent standards (see also Fishbach, 
Friedman, 8c Kruglanski, 2003; Rachlin, 2000). Religion also provides in¬ 
dividuals with strong motivations for adhering to set standards (Bering 8c 
Johnson, 2005; Oner-Ozkan, 2007; Shariff 8c Norenzayan, 2007). In addition, 
religious practice facilitates frequent self-monitoring (e.g., habitual examina¬ 
tion of conscience) (Carter, McCullough, 8c Carver, 2012). 

However, research has also shown that it is possible to secularize particu¬ 
lar mechanisms that facilitate altruistic behavior (e.g., evoking deference to 
moral authority with reminders of secularized justice systems and social con¬ 
tracts) (Shariff 8c Norenzayan, 2007). Nonetheless, it is possible that secular 
mechanisms are not as effective as religious mechanisms at facilitating other 
self-regulatory skills such as delayed gratification or persistence, which play 
a stronger role than altruism in improving student outcomes such as educa¬ 
tional attainment (see Almlund, Duckworth, Heckman, 8c Kautz, 2011). 

Religiosity and Political Tolerance 

The religious component of schooling (i.e., the overtly religious references 
and practices that cannot be legally implemented in public education) may 
lead to self-regulatory and educational benefits, but it may coincidentally 
facilitate socially undesirable outcomes. Interculturalists, for example, worry 
that private, religious schools inhibit the development of political tolerance 
because individuals come to accept particular ideals with an unwillingness to 
consider alternative viewpoints (Gibson, 2010; Gradstein 8cjustman, 2005; 
Nunn, Crockett, 8c Williams, 1978; Wilcox 8cjelen, 1990). 

Sullivan, Pierson, and Marcus (1982) have defined “political tolerance” as 
the “willingness to permit the expression of ideas or interests one opposes” 

(p. 2). As discussed earlier, religious schools are value communities that serve 
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to reinforce shared beliefs. As such, religious school communities tend to be 
more homogenous relative to the populations within which they are estab¬ 
lished. Insofar as religious schools cultivate dogmatic students and ethno- 
centrism, they may propagate political intolerance (Eisenstein, 2008; Gibson, 
2010; Hall, Matz, & Wood, 2010; Sullivan et al., 1982). In contrast, public, and 
even secular private schools ideally have more diverse enrollments, propagat¬ 
ing lessons on coexisting with others and fostering social cohesion (Gut- 
mann, 1987; Macedo, 2003). However, it remains unclear how closely public 
and secular private schools embody this ideal. 

Empirical evaluations of the claims regarding the connections between 
political tolerance and school sector have largely found evidence to the con¬ 
trary. In a review of the literature, Wolf (2005) concluded that private school 
students, particularly those attending Catholic schools, exhibit greater toler¬ 
ance than students in public schools. More recent studies have corroborated 
this conclusion (e.g., Cheng, 2014; Fleming, Mitchell, & McNally, 2014). 
Catholic school students are more likely to form friendships with students of 
other racial and ethnic groups and less likely to engage in racial and ethnic 
conflicts (Greene, Mellow, & Giammo, 1999). However, private secular school 
students score significantly higher on a tolerance index than those attending 
non-Catholic religious schools (Campbell, 2001). While this latter finding 
could indicate that religion deters tolerance, Campbell warns that students’ 
index scores could reflect omitted variable biases that pertain to school selec¬ 
tion and do not necessarily reflect a causal school-sector effect. 

A plausible explanation for these potentially counterintuitive empirical 
findings is that spiritual and moral instruction fosters a strong sense of per¬ 
sonal identity, which may enable students to develop more positive views of 
themselves. Developing a positive view of one’s personal identity is a neces¬ 
sary precursor for developing positive views of others (Banks, 2001). Indi¬ 
viduals who experience a higher degree of self-actualization tend to exhibit 
greater political tolerance (Sullivan et al., 1982). This relationship likely occurs 
because individuals with a stronger sense of self tend to be less threatened 
by others who may hold contrary worldviews. Therefore, religious schools 
have the potential to foster political tolerance by strengthening individuals’ 
personal identity (Short, 2002). Moreover, religion can provide students with 
a coherent moral vision, which is necessary for moral formation, and foster 
dispositions consistent with tolerance (Bellah, Madsen, Sullivan, Swidler, & 
Tipton, 1985; Hunter, 2001). 
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The Effects of Religious Cues 

It is difficult to assess whether there is indeed a causal relationship with 
religion serving as a mechanism (occasionally referred to as a “moral com¬ 
pass”) that can independently shape and influence human behavior and 
outcomes such as individuals’ abilities to exhibit self-regulation and politi¬ 
cal tolerance. Researchers typically address this difficulty by implementing 
controlled experiments that account for confounding factors, but there is a 
tradeoff. Researchers must formalize and simplify abstract concepts — in 
this case, religion and religiosity — to test their effects in controlled settings 
(e.g., Djupe and Calfano, 2012; Harrison & McKay, 2013; Johnson, Rowatt, & 
LaBouff, 2010; Pichon et al., 2007; Shariff &Norenzayan, 2007; Rounding, 
Lee, Jacobson, &Ji, 2012; Uhlmann, Poehlman, Tannenbaum, 8tBargh, 2011). 
We elaborate on the limitations of this approach in the discussion of our re¬ 
sults. For now, we highlight prior work that has used religious cues to induce 
a sense of religiosity and to simulate the effects of religion. 

Of particular relevance to the present study is Rounding et al. (2012), who 
directly tested the hypothesis that religious cues independently strengthen 
the ability to delay gratification and persist through difficult scenarios. 
Among a sample of undergraduate college students, they found that religious 
cues produce greater self-regulatory capacities and more effectively enable the 
replenishment of depleted self-regulatory capacities. Uhlmann et al., (2011) 
similarly found that US adults primed with religious words exerted more 
effort on an anagram task than those who were primed with neutral words. 
However, Harrison and McKay (2013) attempted to replicate the Rounding 
et al. (2012) study, using slightly different methods to measure delayed grati¬ 
fication, and found no significant effects among their own sample of postsec¬ 
ondary students. 

Regarding tolerance, priming postsecondary students with subliminal 
Christian words appears to increase racial prejudice, even when controlling 
for participants’baseline religiosity (Johnson et al., 2010). Conversely, Djupe 
and Calfano (2012) found there was no effect on tolerance when participants 
were cued with inclusive religious values that emphasize building bridges to 
others outside the group. Therefore, prior research suggests that religious cues 
seem to increase intolerance but only if the religious cues promoted exclusive 
values that reinforce in-group identity and association. 

We take a similar approach in this present study to test whether religious 
conceptualizations affect self-regulation and tolerance. However, one signifi¬ 
cant difference with our study and those mentioned in this section is that our 
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sample consisted of secondary, rather than postsecondary students. Therefore, 
it is plausible that these findings would not extrapolate to a younger popula¬ 
tion of student participants. We describe the procedures of our experiment in 
the next section. 


Methods 


Participants and Procedures 

The participants for this study were 180 n th - and i2th-grade students at¬ 
tending a public secondary boarding school in a southern U.S. state. Upon 
arrival to the laboratory, participants were randomly assigned to one of three 
treatment conditions: religious, secular, or neutral priming (control). To con¬ 
ceal the purpose of the study, we told participants that they were completing 
verbal skills exercises, but later informed participants of the intent of the 
study with a debriefing session. All participants, regardless of assigned condi¬ 
tion, completed three tasks in the following order: (a) a priming task (sen¬ 
tence scramble), (b) an impossible task (anagrams), and (c) a general survey 
that included items to collect participants’ responses on the political tolerance 
scale in addition to background demographics and measures testing the ef¬ 
fectiveness of the priming task. 

Priming 

The purpose of priming in psychology experiments is to explore the 
“temporary activation states of an individual’s mental representations and 
how these internal readinesses interact with environmental information to 
produce perceptions, evaluations, and even goal pursuits and social behav¬ 
ior” (Bargh & Chartrand, 2014, p. 316). As such, the technique for this study 
aimed to measure responses and behaviors that occur when experimentally 
activating adolescents’ conceptualizations of religiousness. We administered 
a supraliminal, conceptual priming task for the purpose of inducing powerful 
manipulations while trying to ensure that participants remained unaware of 
the connection between the experimental tasks and the central hypotheses of 
the study (Bargh & Chartrand, 2014). 

We adopted our priming task from Shariff and Norenzayan (2007) and 
Toburen and Meier’s (2010) experimental studies that examined the impacts 
of priming participants with God-related concepts on behavior. This prim¬ 
ing task consisted of ten scrambled, five-word sentences. Participants were 
instructed to eliminate one and then rearrange the four remaining words to 



162 


Journal of Catholic Education / October 2016 


form a coherent sentence. There were three versions of this priming task, one 
for each treatment condition. The ten sets of five words were identical across 
all three conditions with the exception of one word for five of the sentence 
groupings. For the religious-prime group, five of the sentences contained a 
religious word: worship, preacher, heaven, devotion, and commandments. The 
secular-prime group received the same activity except the religious words 
were replaced with approximate, secular equivalents from the participating 
secular school’s lexicon (e.g., the school’s student handbook) that were based 
on face validity in addition to professional feedback from a social psycholo¬ 
gist with expertise in conducting such priming tasks. The secular equivalents 
for this experiment were honor, leader, success, commitment, and expectations. 
The secular equivalents were intended to be synonymous words and con¬ 
cepts that are regularly used and incorporated in these students’ nonsectar¬ 
ian school environment (i.e., words that are commonly found in their school 
mission statement, handbook, and rules). The corresponding words for those 
in the neutral-prime group were eat, path, man, cabbage, and numerous. 

Measure of Persistence 

After completing the priming task, participants began the persistence 
task that consisted of ten anagrams. Participants were asked to unscramble 
them into actual English words. Four of these words could be unscrambled 
into English words {tnkoe/token, yncfa/fancy, ruchs/crush, drnba/brand), but the 
remaining six could not ( padus, alavt, dbhoc, vaofea, kylix, malae) (Smith, Kass, 
Rotunda, 8c Scheider, 2006). The amount of time each participant worked on 
the task before giving up is our measure of persistence. This task served the 
purpose of exhausting participants’ self-regulatory capacities to make it more 
challenging to exhibit such strength in the final task - deferring gratification 
with the payout at the end of the experiment (e.g., Rounding et al., 2012). 

Measure of Political Tolerance 

For the next section, participants completed a general survey which 
included a political tolerance scale developed by Sullivan et al. (1982). This 
section first presented a list of social and political groups “whose beliefs some 
people oppose.” Participants were asked to select the group that they liked 
least, or, if they could think of another group that they opposed more, to 
write down the name of that group instead. The modal choice was Neo-Nazis 
(38 %); Atheists, Fundamentalist Christians, Pro-Life Advocates, Pro-Choice 
Advocates, Republicans, and members of the Westboro Baptist Church were 



Impact of Spiritual Cues 


163 


the next most commonly chosen groups (collectively accounting for an ad¬ 
ditional 46 % of all opposed-group choices). 2 

Participants then answered six Likert-type items that measured their 
willingness to extend various civil liberties to their least-liked group. Re¬ 
sponses were averaged to providing a political tolerance scale score. The items 
included on the political tolerance scale were: 

• [The least-liked group] should be allowed to make a speech in my com¬ 
munity. 

• A member of [the least-liked group] should be able to run for president. 
•[The least-liked group] should be able to hold a rally in public. 

• [The least-liked group] should be outlawed. 

• Books that are written by [the least-liked group] should be banned from 
the library. 

• I would allow a member of [the least-liked group] to live in my neighbor¬ 
hood. 

We also asked an additional Likert-scale item to measure the extent to which 
participants feel “threatened” by their least liked group to control for this per¬ 
ception when analyzing the impacts of religious and secular cues on political 
tolerance (see Djupe 8c Calfano, 2012; Eisenstein, 2008; Gibson, 2010; Sul¬ 
livan et al., 1982). 

General Survey 

Participants additionally were asked to provide demographic information 
in addition to answering survey items that would serve as measures of the 
effectiveness of the priming treatments. Specifically, participants completed 
survey items that served as a self-assessment of their sense of religiosity. 

Since participants experienced the priming task prior to completing the sur¬ 
vey, responses to these items serve as measures for whether the priming task 
had the intended consequence of affecting one’s sense of religiosity. 

Measure of Delayed-Gratification 

The last portion of the survey thanked participants for taking the time to 
participate in the study. Participants were then presented with two choices 
of compensation: receiving an immediate $5 upon exiting the study or $6 for 
waiting for their payment until the following week. The decision to receive 
$5 or $6 serves as our measure of delayed gratification after having exhausted 

2 There were no significant differences across religious, secular, and control conditions 

in the likelihood of a participant choosing a particular “least-liked group”. 
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participants’ self-regulatory capacities from earlier experimental exercises. 
Participants who chose to wait a week for $6 are considered to have demon¬ 
strated a greater willingness to defer gratification (e.g., Rounding et al., 2012). 
Finally, we asked participants two follow-up questions to probe for whether 
any participants were aware of the central hypotheses of the study. We 
ran the analysis with and without participants who exhibited a reasonable 
amount of suspicion regarding the purpose of our experiment. 

Analytic Approach 

We used ordinary least squares and logistic regressions to assess whether 
priming affected persistence, deferred gratification, and political tolerance. 
These regression models estimate average differences in the three outcome 
variables across the three treatment conditions. 3 

Prior to running these models, we conducted two tests to ascertain that 
our experiment was implemented properly. First, we assessed whether our 
randomization procedure effectively randomized the treatment that each 
student participant received. To do this, we ran Kruskal-Wallis tests to see 
if the participants’ observable characteristics differed across the three treat¬ 
ment conditions. If treatment conditions were randomly assigned, we should 
observe no such differences. 

We ran a second test to assess whether our priming techniques had 
their intended effects. In the general survey that students completed after 
the treatment, we asked participants several questions about their religios¬ 
ity. Specifically, participants were asked about their engagement in religious 
activity as well as the extent to which they felt that religion influenced their 
everyday choices. Combining responses to these survey items, we constructed 
a standardized index that indicates an individual’s level of religiosity. We 
then use ordinary least squares to predict individual religiosity using indica¬ 
tor variables for the three treatment groups and other covariates that capture 
the individual’s demographic characteristics. If our priming task worked as 
intended, then we should observe participants in the religious priming treat¬ 
ment condition to exhibit greater levels of religiosity. 

3 Strictly-speaking, it is not necessary to control for individual background character¬ 

istics (e.g., gender, grade, race) in our models to the estimate causal effects of each treatment 
condition because we randomly assigned participants to the treatment conditions. However, 
we control for them to improve the precision of our estimates. 
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Results 

Table 1 presents the descriptive statistics of the participants as well as 
shows the effectiveness of the randomization procedure for achieving com¬ 
parable balances across conditions on observable characteristics. While 
there appear to be modest differences in the characteristics across the three 
treatment conditions, none of these differences was found to be statistically 
significant. Logistic regressions of experimental condition on these covariates 
suggest that there was no significant differences across treatments (^-values 
ranging from 0.37 to 0.94). 

Table 1 

Descriptive Statistics of Study Participants 



Religious 

Priming 


Secular 

Priming 


Neutral 

Priming 


Population 

N 

% 

N 

% 

N 

% 

Overall 

61 

34 

67 

37 

52 

29 

Sex 

Male 

31 

51 

30 

45 

26 

50 

Female 

30 

49 

37 

55 

26 

50 

Student’s Grade 

11 

34 

56 

42 

63 

27 

52 

12 

27 

44 

25 

37 

25 

48 

Racial Background 

Hispanic 

2 

3 

1 

2 

1 

2 

White 

43 

72 

45 

70 

39 

76 

American Indian 

1 

2 

0 

0 

0 

0 

Black 

3 

5 

3 

5 

1 

2 

Asian 

9 

15 

9 

14 

6 

12 

Other 

2 

3 

6 

9 

4 

8 


Note. Numbers for racial background do not sum to the total for overall number of 
participants in conditions where participants chose to omit an indication for self- 
identified race/ethnicity. Percentages represent the percentage of those with non¬ 
missing values. 
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Table 2 


Effects of Religious and Secular Priming 



(1) 

Religiosity 

(2) 

Persistence 

(3) 

Gratification 

(4) 

Tolerance 

Religious Priming 

0.53*** 

-0.30 

2.05* 

0.28* 


(0.19) 

(0.21) 

(0.83) 

(0.16) 

Secular Priming 

0.31* 

-0.07 

0.84 

0.04 


(0.18) 

(0.16) 

(0.33) 

(0.15) 

Race/Ethnicitv 





Hispanic/Latino 

0.38 

-0.22 

2.51 

0.81*** 


(0.53) 

(0.32) 

(2.51) 

(0.12) 

American Indian 

1.30*** 

-0.69*** 

N/A 

0.78*** 


(0.18) 

(0.20) 


(0.16) 

African-American 

-0.07 

0.24 

0.46 

-0.26 


(0.43) 

(0.38) 

(0.41) 

(0.52) 

Asian 

0.32 

0.32 

1.39 

-0.38** 


(0.19) 

(0.23) 

(0.66) 

(0.15) 

Other 

-0.30 

0.03 

0.52 

0.67** 


(0.26) 

(0.38) 

(0.36) 

(0.31) 

Male 

-0.35** 

-0.00 

1.11 

0.21 


(0.16) 

(0.17) 

(0.36) 

(0.13) 

12th Grader 

0.18 

-0.30* 

0.38*** 

-0.02 


(0.14) 

(0.17) 

(0.12) 

(0.15) 

Perceived Threat 




_0 ^ 2 *** 





(0.07) 

Constant 

-0.24 

0.22 

1.71 

-0.21 

(0.17) 

(0.20) 

(0.57) 

(0.18) 

N 

174 

174 

173 

173 


Note. ***p < 0.01; **p < 0.05, *p <0.10. Coefficient estimates for Religiosity, Persistence, and Politi¬ 
cal Tolerance are in terms of standard deviations; estimates for Delayed Gratification are in logistic 
odds ratios. The omitted category for racial background is white. We are unable to obtain a coefficient 
estimate for the covariate on American Indian in the analysis on Delayed Gratification because of perfect 
prediction between this observed characteristic and binary outcome. 
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As shown in the first column of Table 2, the priming task had its intended 
effect. The religious priming treatment significantly increased participants’ 
sense of religiosity by 53 % of a standard deviation relative to the control 
group (p < o.01). The secularized priming also appeared to impact partici¬ 
pants’ sense of religiosity relative to the control (p = 0.10), but the estimated 
effect was just over half as strong as that of the religious prime. Ibis latter 
finding could suggest that the use of secularized equivalents to our religious 
cues potentially conjured a vague sense of religiosity with the participants in 
that condition. 

The results with regard to persistence and deferred gratification are found 
in columns 2 and 3. Participants spent an average time of n minutes and 45 
seconds with the 10 anagrams for the persistence task. Time spent on this 
task was not found to be statistically significant across conditions, suggest¬ 
ing no differences in exhibited persistence on the regulatory-depletion task. 
However, there were significant differences in participants’ choices made with 
regard to payment preferences at the end of the experiment. The religiously- 
primed participants were more than twice as likely than participants in 
either the control or secularized groups to defer gratification by opting for 
the marginally higher, delayed payout (p = 0.08 and p = 0.03, respectively). 
Participants randomly assigned to the secularized-priming condition did not 
significantly differ from those in the neutral condition with regard to their 
payout choices. 

Religious priming was also found to increase political tolerance. As shown 
in column 4, our estimates indicate that participants who received religious 
cues score 28 % of a standard deviation higher on the political tolerance scale 
than participants who received neutral cues {p = 0.08). Participants primed 
with religious words also scored 24 % of a standard deviation higher than 
those from those in the secularized group, but this difference fails to achieve 
a conventional level of statistical significance (p = 0.15). Finally, participants 
who received secular cues are not statistically distinguishable from those who 
received neutral cues (p = 0.81). 4 

4 There were 16 participants (9 percent of the students) whose post-experiment 

responses reflected a reasonable degree of suspicion with regard to the purpose of the tasks. 
While a participant’s knowledge of the purpose of the study could influence their responses, 
the direction of the bias is uncertain. The results presented are those for the entire sample. 
However, we have re-run all analyses, excluding participants who expressed some suspicion. 
Excluding these students has a modest effect on estimates. Excluding suspicious participants 
increases the estimated impact for the religious prime condition on deferred payout (p = 

0 . 03 ) but attenuates the political tolerance result (p = 0 . 26 ). 
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Discussion 

Collectively, these results suggest that neither religious nor secularized 
cues produce immediate impacts on persistence with our sample. However, 
after having self-regulatory capacities exhausted from a persistence exer¬ 
cise, participants randomly assigned to the religious priming condition were 
much more likely to replenish these regulatory capacities as exhibited in their 
decision to forgo immediate gratification. These positive effects on deferred 
gratification were not replicated with the secularized equivalents of religious 
primes. Our findings also suggest that religious cues have a positive impact 
on political tolerance and, at worst, do not appear to increase intolerance. 
However, these results were not significantly different than those with the 
participants in the secularized priming group. Since participants were ran¬ 
domly assigned to one of three treatment conditions, we can be fairly confi¬ 
dent that these impacts reflect causal assessments of the independent impacts 
of religious cues and their secularized equivalents. 

These findings could carry important implications for the capacity and 
ability for religious and nonreligious schools to promote publicly-valued 
student outcomes. We interpret these results as preliminary evidence to sug¬ 
gest that religious-based education provides benefits that secularized versions 
cannot replicate. In particular, the overt religious component of Catholic 
schools (and, more broadly, religious schools) that is constitutive of their 
organizational identity appears to independently contribute to their effective¬ 
ness by exerting a positive influence on self-regulatory behaviors in terms of 
facilitating the replenishment of exhausted self-regulatory capacities. Given 
this causal relationship, in addition to the strong association between this 
noncognitive skill and academic outcomes such as high school degree at¬ 
tainment and college matriculation found in prior studies, there is reason to 
believe that the religious component of faith-based schools has a positive, 
independent effect on publicly-valued educational outcomes. 

Many high-achieving public charter schools are modeled after Catholic 
schools but are legally required to omit any sort of explicit religious compo¬ 
nent. While this exclusion would seemingly have no effect on these schools’ 
abilities to match the successes of Catholic and other faith-based schools, our 
results, paired with findings from recent charter school studies, should raise 
questions with regard to this assumption. Specifically, students who win lot¬ 
teries to attend oversubscribed charter schools in Boston have shown remark¬ 
able increases in measures of cognitive achievement (e.g., SAT scores, stan¬ 
dardized test scores) relative to their public school peers. Yet thus far, there 
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is no evidence that these charter schools produce equally sizeable effects in 
terms of rates of high school graduation and college enrollment (Angrist, 
Cohodes, Dynarksi, Pathak, 8c Walters, 2016).These results are in stark con¬ 
trast to the earlier-cited literature on Catholic schools’ successes that tend to 
exhibit better outcomes with regard to educational attainment. While there 
are a number of plausible explanations for such differences, our findings may 
imply that the regular activations of students’ religious conceptualizations can 
play an important role in enhancing these outcomes. 

The evidence that religion can assist in the promotion of publicly-valued 
educational outcomes is perhaps valuable in itself, but the findings concern¬ 
ing tolerance could also help to alleviate apprehensions regarding plausible 
drawbacks of faith-based education. Religion is often assumed to be a source 
of or justification for intolerance, but our results corroborate the results of 
earlier works that find religion in education contexts to potentially supply the 
moral capital and to foster dispositions that facilitate tolerance (e.g., Bel- 
lah et al., 1985; Eisenstein, 2008). It is again worth noting that effects with 
secularized primes were not significantly different from religious primes on 
this outcome. This latter finding possibly implies that increasing tolerance 
can be accomplished by activating a student’s moral sense, but this activation 
does not necessarily require religious conceptualizations. However, regard¬ 
less of whether this particular result is replicable with secularized equivalents, 
the effects from this aspect of the study potentially refute the assertion that 
religion has an independent, negative effect on tolerance. 

Finally, our findings speak to an important trend in Catholic schools 
that could possibly be remediated through policy. Many schools have closed 
over the past 50 years, and others have converted to public charter status as a 
means for preservation. Results of this study raise important issues pertain¬ 
ing to school choice policy and difficult choices that many religious school 
administrators increasingly face with regard to the decision to convert to 
charter school status. In particular, although endorsing the expansion of 
charter schools over policies that enable religious school choice is likely a 
politically solvent strategy, it could come at the cost of potential gains with 
regard to self-regulation and other noncognitive skills that are important for 
educational attainment, success in the labor-market, and other positive life 
outcomes (Almlund et al., 2011). Moreover, while an individual school may 
retain a great deal of its identity in terms of personnel and student popula¬ 
tion after its conversion to charter status, the loss of overt religious cues that 
comes with this conversion may inhibit their abilities to continue facilitating 
such outcomes. 
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Limitations 

The sample for this study consisted of predominantly white, higher- 
achieving nth- and i2th-grade students from a southern U.S. state. Though 
we have posited what our findings could mean for Catholic as well as other 
religious schools, we must be careful not to overstate their conclusiveness. 
Conducting an experiment in a highly-controlled, laboratory setting lends 
confidence that the results are directly caused by the differences in treat¬ 
ment conditions; however, our homogenous sample likely limits the extent 
to which we can generalize these findings with much confidence (e.g., we do 
not know whether and the extent to which these findings would occur with 
elementary school students as well as those who reside in urban communi¬ 
ties) (Levitt & List, 2007). 

That being said, the use of controlled, laboratory experiments has become 
an increasingly popular method for developing policy-relevant hypotheses 
to incorporate in field experiments (Bowen, Buck, Deck, Mills, 8c Shuls, 

2015; Hastings 8c Weinstein, 2008; Perez, 2011). We encourage researchers to 
consider how tests similar to the one we have conducted can be implemented 
in contexts to provide greater generalizability to a broader population of 
students in conditions that more closely reflect their everyday lives in school. 
Such scholarly pursuits would be valuable for better understanding issues and 
informing the debate regarding the place of religious schools in civil society. 

It is also worth noting that these findings pertain to a fairly narrow aspect 
of faith-based education. We do not wish to convey the notions that religious 
schools are essentially identical to public schools with the exception of overt 
religious words and symbols and that this component is the lynchpin of their 
successes. The extent to which the religious cues that we have embedded into 
our experiment mimic religious activations that occur in more natural school 
settings requires further investigation. One-time religious activations are sub¬ 
stantively different from being in an environment permeated by a religious 
ethos. It may be possible that more-regular religious activations that occur in 
faith-based schools lead to more-pronounced effects, or it might be the case 
that such influences attenuate with increased exposure. However, by examin¬ 
ing this particular aspect of religious schools, we hope that these results can 
further inform the larger investigation for determining the roles that various 
components, practices, and contexts, play with regard to how these schools 
positively impact student development. 
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Conclusion 

The results of this study raise important considerations when assessing 
claims about the value of the explicitly religious component of faith-based 
education. There seems to be something unique about religious, particularly 
Catholic, schools that cannot be fully captured with secularized replicas. Spe¬ 
cifically, the evidence from this study suggests that religious schools provide 
environments that are likely to activate conceptualizations that enable stu¬ 
dents to more effectively replenish their self-regulatory capacities as exhibited 
in the ability to defer the need for more-immediate gratification, a skill com¬ 
monly found to translate into greater educational attainment. In conjunction 
with the benefits to Catholic and other faith-based schooling, concerns have 
arisen with regard to the possibility that religion facilitates negative effects 
pertaining to the growth and development of civic values. Our preliminary 
results suggest that the priming effects from religious cues in these settings 
positively impacts self-regulation and does not further affect the development 
of political intolerance. 

Although we believe this study helps to reveal reasons for the effective¬ 
ness of Catholic schools with regard to outcomes pertaining to educational 
attainment, additional studies are still needed to further investigate the 
mechanisms by which religious cues produce these effects. For example, 
do cues activate previously learned Judeo-Christian values that emphasize 
benefits that often come from deferring instant gratification in the present 
for greater rewards in the future? Addressing this question and others that 
help to explain the mechanisms behind this process would help determine 
how to best make use of these cues. Replications or even field tests to explore 
the extent to which such effects can or cannot be emulated in secular con¬ 
texts would speak further to the generalizability of our results. However, our 
findings seem to lend credibility to the claim that the overtly religious com¬ 
ponent of Catholic and religious schools can facilitate nontrivial, publicly- 
valued benefits to students without necessarily fostering commonly-perceived 
drawbacks that pertain to the development of civic values. 
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